Skip to content

[core][flink][lumina] Allow building Lumina global index on DV-enabled tables - #8930

Draft
XiaoHongbo-Hope wants to merge 1 commit into
apache:masterfrom
XiaoHongbo-Hope:feature/lumina-index-support-dv-tables
Draft

[core][flink][lumina] Allow building Lumina global index on DV-enabled tables#8930
XiaoHongbo-Hope wants to merge 1 commit into
apache:masterfrom
XiaoHongbo-Hope:feature/lumina-index-support-dv-tables

Conversation

@XiaoHongbo-Hope

@XiaoHongbo-Hope XiaoHongbo-Hope commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Purpose

Allow building the Lumina vector global index on deletion-vector (DV) enabled
tables. GenericGlobalIndexBuilder rejected every generic (non-btree/bitmap)
global index on DV tables. Lumina vector search already filters DV-deleted rows at
read time via the live-row pre-filter, so building the index over all physical rows
(a superset) is safe.

Change

  • Add an opt-in GlobalIndexerFactory.supportsDeletionVectors() capability
    (default false), mirroring the existing supportsFullTextSearch().
  • Override it to true in Lumina.
  • Relax the DV guard to allow only opt-in index types on DV tables, still rejecting
    the rest; wire the resolved index type through the builder.

Dependencies / merge order

This PR only relaxes the build-side guard. Correctness of reads on DV tables relies
on two independent read-path fixes, which were split out and should merge before
this one:

(The union / two-phase live-row fix landed earlier in #8939.)

@XiaoHongbo-Hope
XiaoHongbo-Hope force-pushed the feature/lumina-index-support-dv-tables branch 3 times, most recently from ef31d32 to 5b03c02 Compare July 30, 2026 13:59
@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as draft July 30, 2026 14:08
…d tables

GenericGlobalIndexBuilder rejected every generic (non-btree/bitmap)
global index on deletion-vector tables. Lumina vector search already
filters DV-deleted rows at read time via the live-row pre-filter, so
building the index over all physical rows (a superset) is safe.

Add an opt-in GlobalIndexerFactory.supportsDeletionVectors() capability
(default false), override it to true in Lumina, and relax the guard to
allow only opt-in index types on DV tables while still rejecting the
rest. Wires the resolved index type through the builder.
@XiaoHongbo-Hope
XiaoHongbo-Hope force-pushed the feature/lumina-index-support-dv-tables branch from 5b03c02 to 5cb2e47 Compare July 30, 2026 14:13
@XiaoHongbo-Hope XiaoHongbo-Hope changed the title [core][flink] Support building Lumina global index on deletion-vector tables [core][flink][lumina] Allow building Lumina global index on DV-enabled tables Jul 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant